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Abstract 

In this paper we study a two person zero sum stochastic differential game in weak 
formulation. Unlike standard literature which uses strategy type of controls, the weak 
formulation allows us to consider the game with control against control. We shall 
prove the existence of game value under natural conditions. Another main feature of 
the paper is that we allow for non-Markovian structure, and thus the game value is a 
random process. We characterize the value process as the unique viscosity solution of the 
corresponding path dependent Bellman-Isaacs equation, a notion recently introduced 
by Ekren, Keller, Touzi and Zhang [2] and Ekren, Touzi and Zhang [T51 [TBI [T7] . 
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1 Introduction 

Since the seminal paper Fleming and Souganidis [19] , two person zero sum stochastic differ- 
ential games have been studied extensively in the literature, see e.g. [TJ, [2], [3], [4], [5], [7J, 
|13j . |18j . |21j . |22j . [23], [27], [33], to mention a few. There are typically two approaches. 
One is to use the viscosity theory, namely to show that the value function of the game is 
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the unique viscosity solution of the associated Bellman-Isaacs equation, and the other is to 
use the Backward SDE approach, which characterizes the value process as the solution to 
a related BSDE. 

To be precise, let u and v denote the controls of the two players, B a Brownian motion, 
X ,u,v the controlled state process in the strong formulation: 

x S,u,v _ x + / Vs )^ s + / a (s,u s ,v s )dB s , (1.1) 

J J 

and J(u,v) the corresponding value (utility or cost) which is determined by X s,u ' v , B, and 
(u,v). The lower and upper values of the game are defined as: 

V_ := sup inf J(u,v), Vq := inf sup J(u, v), 
ueu »eV vev ueU 

where U and V are appropriate sets of admissible controls. It is clear that V_q < Vq. Two 
central problems in the game literature are: 

(i) When does the game value exists, namely Vq := V_ = Vq? 

(ii) Given the existence of the game value, is there a saddle point? That is, we want to 
find (u*,v*) E U x V such that Vq = J(u*,v*) = inf„ e y J(u*, v) = sup ueU J(u, v*). 

However, even under reasonable assumptions, the game value may not exist. We shall 
provide a counterexample, see Example 18. II below, which is due to Buckdahn. 

To overcome the difficulty, Fleming and Souganidis [19] introduced strategy types of 
controls: 

V^q := sup inf J(ct(v), v), Vq := inf sup J(u, /3(u)), 

Here a : V — > U and /3 : U — >■ V are so called strategies and A, B are appropriate sets of 
admissible strategies. Under the Isaacs condition and assuming the comparison principle for 
the viscosity solution of the corresponding Bellman-Isaacs equation holds, [19] showed that 
Vq = Vq. This work has been extended by many authors in various aspects. In particular, 
Buckdahn and Li [5J defined J(u, v) via Backward SDEs, and very recently Bayraktar and 
Yao [1] used doubly reflected BSDEs. The main drawback of this approach, however, is 
that the two players have non-symmetric information, and for V^ and Vq, the roles of two 
players are switched. Consequently, it is less convenient to study the saddle point in this 
setting. 

We propose to attack the problem in weak formulation, which is more convenient for 
proving the Dynamic Programming Principle. Note that in (jl.ip the controls (u, v) actually 
mean u(B.),v(B.). Our weak formulation is equivalent to the following feedback type of 
controls: 

x w,u,v = x+ j l b ( SfUs (x w > u ' v ),v s (X w > u ' v ))ds+ I a(s,u s (X w > u > v ),v s (X W ' u > v ))dB S: (1.2) 
Jo Jo 
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Here X. ' u ' v denotes the path of X w ' u ' v and the superscript stands for weak formulation. 
Under natural assumptions, we show that the game value does exist. The advantage of the 
weak formulation setting is that we are using control against control, thus one can define the 
saddle point naturally. When there is only drift control, namely a is independent of (u,v), 
one can prove the existence of saddle point under mild conditions. However, when there is 
diffusion control, the problem is much more involved. We shall obtain some approximate 
saddle point. 

We remark that, when there is only drift control, the weak formulation has already been 
used in the literature, see Bensoussan and Lions [2] for Markovian case and Hamadene and 
Lepetier |21j for non-Markovian case. The former one relies on PDE arguments and the 
latter one uses Backward SDEs. The advantage in this case is that one can easily obtain 
the weak solution of SDE (|1 .2j) by applying the Girsanov Theorem. Our general case with 
diffusion control has different nature. Roughly speaking, the drift control is associated with 
semi-linear PDEs, while the diffusion control is associate with fully nonlinear PDEs. We 
also note that, in a Markovian model but also with optimal stopping problem, Karatzas and 
Sudderth [23] studied the game problem with diffusion control in weak formulation, under 
certain strong conditions. 

Another main feature of our paper is that we study the game in non-Markovian frame- 
work, or say in a path dependent manner. The standard approach in the literature, e.g. 
[19] and [5], is to prove that the lower value and the upper value are a viscosity solution (or 
viscosity semi-solution) of the corresponding Bellman-Isaacs equation, then by assuming 
the comparison principle for the viscosity solution of the PDE, one obtains the existence of 
the game value. These works rely on the PDE arguments and thus works only in Markovian 
setting. In a series of papers, Ekren, Keller, Touzi and Zhang p3] and Ekren, Touzi and 
Zhang [151 113 E] introduced a notion of viscosity solution for the so called path dependent 
PDEs and established its wellposedness. This enables us to extend the above approach to 
path dependent setting. Indeed, based on the dynamic programming principle we establish, 
we show that the lower value and the upper value of the game are viscosity solutions of the 
corresponding path dependent Bellman-Isaacs equations. Then, under the Isaacs condition 
and assuming the uniqueness of viscosity solutions, we characterize the game value as the 
unique viscosity solution of the path dependent Bellman-Isaacs equation. 

Finally we remark that, due to weak formulation with diffusion control, this paper 
is by nature closely related to the second order BSDEs (2BSDEs, for short) introduced 
by Cheridito, Soner, Touzi and Vicoir [8j and Soner, Touzi and Zhang |31[ I32j. and the G- 
expectation introduced by Peng [29J. While more involved here, our arguments for Dynamic 
Programming Principle follow the idea in [31] [32] and Peng [28]. However, G-expectations 
and 2BSDEs involve only stochastic optimization and thus the generator is convex in terms 
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of the hessian. Consequently, the dynamic value process is a supermartingale under each 
associated probability measure. For our game problem, the Bellman-Isaacs equation is non- 
convex, and the value process is not a supermartingale anymore. Under additional technical 
conditions, we conjecture that our value process will be a semi-martingale. This requires to 
develop a semi-martingale theory under nonlinear expectation and to generalize the 2BSDE 
theory to non-convex generators. We established some norm estimates for semi-martingales 
in another paper Pham and Zhang [30] and will leave the general 2BSDE theory for future 
research. 

The rest of the paper is organized as follows. In Section [2] we present some preliminaries. 
The game problem is introduced in Section [3l In Sections 0] and [5] we prove the dynamic 
programming principle and the viscosity property, respectively. In Section [6] we study the 
comparison principle for PPDEs and in Section [7] we investigate approximate saddle points. 
Finally some technical proofs are presented Appendix. 

2 Preliminaries 

2.1 The canonical space 

Let Q, := {a; £ C([0,T],M rf ) : loq = 0}, the set of continuous paths starting from the 
origin, B the canonical process, F the filtration generated by B, ¥q the Wiener measure, 
and A := [0, T] x O. Here and in the sequel, for notational simplicity we use to denote 
vectors or matrices with appropriate dimensions whose components are all equal to 0. Let 
§> d denote the set of d x d matrices, §> := {a £ § d : a > 0}, and 

x ■ x' := Ylt=i x i x 'i f° r an y ^ 7:7':= Traced'] for any 7,7' £ § d . 

We define a norm on $7 and a metric on A as follows: for any (t,u), (t',u)') £ A, 

\\u)\\t := sup \u s \, doo((t,o;), (i',u/)) := \t - t'\ + \\uj. m - w' At ,|L. (2.3) 

0<s<t 

Then (fi, || • \\t) and (A, doo) are complete metric spaces. 

Definition 2.1 Let Y : A — > R be an ¥ -progressively measurable process. 

(i) We say Y € L°°(A) ifY is bounded. 

(ii) We say Y £ C°(A) (resp. UC(A)) ifY is continuous (resp. uniformly continuous) in 
(t,u). Moreover, we denote C b °(A) := C°(A) nL°°(A) and UC b (A) := UC(A) n L°°(A). 
(hi) We say Y G W ifY is bounded from above, upper semi- continuous (u.s.c. for short) from 
right in t, and there exists a modulus of continuity function p such that for (t, uj), (t', oj') E A: 

Y(t, uj) - Y(t', J) < p(d co {(t, w), (t', cj'))) whenever t < t' , (2.4) 

and we say Y £lA if —Y £ U_. 
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It is clear that UnU = UC b (A). Moreover, we denote by L°°(A,R d ) the space of Re- 
valued processes whose components are in L°°(A), and define other similar notations in the 
same spirit. 

We next introduce the shifted spaces. Let < s < t < T. 

- Let f2* := {w G C([t,T],M. d ) : u>% = 0} be the shifted canonical space; B l the shifted 
canonical process on Q*; F* the shifted filtration generated by B t , P the Wiener measure 
on 0*, and A* := [t,T] x 0*. 

- Define || • [| s on O*, doo on A* x A*, and C°(A i ) etc. in the spirit of (12. 3ft and Definition 

- For w6(l s and to' G Q t , define the concatenation path w ®j w' 6 Q s by: 

(u)® t w')(r) :=w r l[ 8)t )(r) + (wt + w£)l[ t)T ](r), for all r G [s,T]. 

- Let s G [0, T) and w G fi s . For an J^-measurable random variable £, an F s - 
progressively measurable process X on f2 s , and t G (s,T], define the shifted J^-measurable 
random variable £ t,tJ and F*-progressively measurable process X t,w on O by: 

f{u/) := £(w ®t a/), X*> w (u/) := X(oj ®t a;'), for all J G 0*. 

It is clear that, for any (t, oS) G A and any Y G L°°(A), we have F* ,<J G L°°(A*). Similarly 
the property holds for other spaces defined in Definition 12.11 

2.2 Probability measures 

In this subsection we introduce the probability measures on f2* in different formulations. 
First, let a G L°°(A,§^ ), b G L°°(A,R d ). Define 

r s,a,b ._ Pq d ( X S,*,byi where xf' a,6 := / b s ds+ [ a s dB s , P -a.s. (2.5) 

./o 

Here the superscript 5 stands for strong formulation. We next introduce the corresponding 
weak formulation. We denote a probability measure P on Q as f w,a,b if 

M t 6 := B t - [ b s ds is a P-martingale and (M 6 )t = / a 2 s ds P-a.s. (2.6) 
Jo Jo 

Here the quadratic variation (M b ) is under P. We remark that F w > a > b := P o {X w ^ h )~ x , 
where X W ' a ' b is a weak solution of the following SDE (with random measurable coefficients): 

x W,a,b._ I hs ( X w >°' b )ds + f a s {X W ' a ' b )dB s , P -a.s. (2.7) 
io Jo 

In other words, we are considering feedback type of controls. 
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In this paper we shall use the weak formulation, which is more convenient for proving 
Dynamical Programming Principle. We note that, for arbitrarily given (a, b), the SDE (|2,7p 
may not have a weak solution, namely there is no P such that P = pW>°'> 6 . Let 

: = <; (a, b) G lL^(A,S> n J x jl^(A,M"J : SUH/ II2.YI) Has a unique weak solution;*; 

(2i 



[(er,6) G L°°(A,S^ ) x L°°(A,lR c( ) : SDE (J27T]) has a unique weak solution}; 
E S := |(<r,6) G L°°(A,S| ) x L°°(A,M d ) : SDE (|27f]) has a unique strong solution}. 



For probability measures on the shifted space 0* , we define p 51 '*- "^ pW,i,a-,6^ an( j ^ w,t ^ 
etc. similarly. 

We next introduce the regular conditional probability distribution (r.c.p.d for short) due 
to Stroock and Varadhan [33] . We shall follow the presentation in Soner, Touzi and Zhang 
|31j . Let P be an arbitrary probability measure on f2 and r be an F- stopping time. The 
r.c.p.d. {P r ' w ,w G n} satisfies: 

• For each oj, P T ' W is a probability 

• For every bounded J-^-measurable random variable £: 

E p [i\T T ] (oj) = E pT: " [fW>») , P-a.s. (2.9) 

The following simple lemma will be important for the proof of Dynamic Programming 
Principle in Section H] below. Its proof is postponed to Appendix. 

Lemma 2.2 Let (<r,b) G E S (resp. r W ), t G [0, T], {Ei, 1 < i < n} C Tt be a partition of 
f2, and (o- l ,b % ) G E S,t (resp. 3 '*). Define 

n n 

a{oj) := <7(w)l [0)t ) +J2a i ( y J)l & l m , 6(w) := &(w)l[ ,t) + X) 6 X w *) 1 s*l[t,T]- 

i=l i=l 

T/zen (a, 6) G H S fresp. H^J, and, for i = 1, ■ - ■ ,n, 

2.3 Viscosity solutions of path dependent PDEs 

Our notion of viscosity solutions of Path Dependent PDEs (PPDEs for short) is introduced 
by Ekren, Keller, Touzi and Zhang [14j for semilinear PPDE and Ekren, Touzi and Zhang 
[15\ [T6] for fully nonlinear PPDE. We follow the presentation in [15} [T6] here. 
For any constant L > 0, denote 

Vt:={F w ^ b :\b\<L,0<a<V2LI d }, and := U L>0 Vl (2.10) 

We remark that in we do not require the uniqueness of weak solution. 
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Let Y G C (A). For t G [0, T), we define the right time-derivative, if it exists, as in 
Dupire [12] and Cont and Fournie [9]: 

8 t Y(t,u) := ]im T [Y(t + h,u;. At )-Y(t,Lj)]. (2.11) 

For the final time T, we define, whenever the following limit exists: 

d t Y(T,u) : = limd t Y(t,Lo). (2.12) 

Definition 2.3 (i) We say Y G C 1 ' 2 (A) if Y £ C°(A), d 4 Y G C°(A), and tfiere exist 
d w y G C°(A,IR d ), d^Y G C^A.S*) sucA tfiat, /or any (s,oj) G [0,T) x Q and any F G V^, 
Y s,ul is a local W-semimartingale and it holds: 

dY t s '" = (d t Y t ) s <"dt + (d u Y t y*> ■ dB s t + ^(d^Yt)^ : d(B s ) t , P-a.s. (2.13) 

(ii) We say Y G Cl' 2 {A) ifYe UC b (A), d t Y G C%(A), and the above d u Y and d^Y exist 
and are in C£(A,R d ) and C°(A,S d ) ; respectively. 

Next, let T denote the set of F-stopping times, and % C T the subset of those hitting 
times H taking the following form: for some open and convex set O C M. d containing and 
some < to <T, 

H := inf{t : B t G O c } A t = inf{t : d(u t , O c ) = 0} A t . (2.14) 

We may define C 1,2 (A t ), C^' 2 (A*), T*, and similarly. It is clear that, for any {t,u) 
and Y G C X ' 2 {A) (resp. Y G C fe 1,2 (A)), we have Y*-" G C 1 ' 2 (A*)(resp. Y*> w G C 6 1>2 (A)), and 
for any H G % such that n(u>) > t, we have H*' w G 

For any L > 0, (i, cj) G A with t < T, and F-adapted process 1", define 

,4 L Y(t,w) := \tp G C b 1,2 (A) : for some h G H\ 



(<p-Y t n(t,0)= inf inf E p [(<p- Y^) rAH ]j, 

J^Y(t,co) := |y> G C b 1,2 (A) : for some H G U\ 

(<p-Y t >»)(t,0)= sup sup E p [(^-Y^) rAH ]). 



(2.15) 



rer* Pert 



We are now ready to introduce the viscosity solution of PPDEs. Consider the following 
PPDE with generator G: 

- d t Y t - G{t, u, Y t , d u Y t , d^Yt) = 0. (2.16) 
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Definition 2.4 (i) Let L > 0. We say Y G U_ (resp. U) is a viscosity L-subsolution (resp. 
L- super solution) of PPDE \2.10i) if, for any (t,oj) G [0, T) x Q and any ip G r 4. Z/ y(t, lj) 
(resp. (p £ A L Y(t,oo)): 

(-%,-6^(,y^,0 w p,Oo)(t,O) < (resp. >) 0. 

(ii) We say 1" G (resp. U) is a viscosity subsolution (resp. supers olution) of PPDE \2. 1 6\) 
ifY is viscosity L-subsolution (resp. L- super solution) of PPDE li2.16\) for some L > 0. 

(iii) We say Y G UC\(A) is a viscosity solution of PPDE \2.1@) if it is both a viscosity 
subsolution and a viscosity supersolution. 

Remark 2.5 For < L\ < L 2 , obviously V l Li C V{ 2 and A L2 Y(t,oo) C A Ll Y(t,oo). Then 
one can easily check that a viscosity Li-subsolution must be a viscosity L2-subsolution. 
Consequently, Y is a viscosity solution of PPDE (|2.16p iff there exists an L > 1 such that 
for all L > L, Y is a viscosity L-subsolution. However, we require the same L for all (t,uj). 
A similar statement holds for the viscosity supersolution. 

Remark 2.6 (i) In the Markovian case, namely Y(t, lj) = Y(t, uit) and G = g(t, Dt,y, z, 7), 
our definition of viscosity solution is stronger than the standard viscosity solution in PDE 
literature. That is, Y is a viscosity solution in our sense implies it is a viscosity solution in 
the standard sense as in Crandall, Ishii, and Lions |10j . 

(ii) The state space A of PPDEs is not locally compact, and thus the standard arguments 
by using Ishii's lemma do not work in path dependent case. The main idea of |144 [T5l [T6] is 
to transform the definition to an optimal stopping problem in f)3.2[) . which helps to obtain 
the comparison and hence the uniqueness of viscosity solutions. ■ 

3 The zero-sum game 
3.1 The admissible controls 

Let U and V be two Borel measurable spaces equipped with some topology. From now on 
we shall fix two F-progressively measurable mapping: 

a:[0,T]xUx¥^§to. 6: [0,T] xUx V^M d . 
We shall always assume 
Assumption 3.1 a and b are bounded by a constant Cq. 
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For t G [0,T], let U t (resp. Vt) denote the set of U- valued (resp. V- valued), F'- 
progressively measurable processes u (resp. v) on A*. Throughout the paper, when (u,v) G 
Ut x Vt is given, for any process <p on A* with appropriate dimension, we denote 



(p s := <p^ u ' v := ip s a(s,u s ,v s ). 



Define 



E t : = G U t X V t ■ (a(;U,v),b(-,u,v)) G A S '^ 



(3.1) 



(3.2) 



We note that, from now on, the o~,b in previous section will actually be a(t,ut,vt) and 
b(t,u t ,vt) for some (u,v) G „4o- m particular, for the convenience of studying the BSDE 
later, we are considering SDE in the form 



X 



t,u,v 



a(r,u r (X!' u ' v ),v r (x!' u ' v )) dBt + b^UriX^'^^riX^^dr , P^-a.s. (3.3) 



Moreover, one can easily check that there exists a P '"'"-Brownian motion W ,u ' v such that 



dB\ = cr(s,u s ,v s ) dWg' u,v + b(s,u s ,v s )ds 



a.s. 



(3.4) 



To formulate the game problem, we shall restrict the controls to subsets Ut C Ut and 
Vt C Vt whose elements u and v take the following form: 



m— 1 rn to— 1 rii 

u = j2J2 u ij i E) i [u,u +1 ), v=y^ X^'N-^+i)' where 



(3.5) 



i=0 3=1 



i=0 j=l 



t = to < ■ ■ ■ < t m = T, {Ej}\<j< ni C J 7 ', is a partition, and Uy, are constants. 
It is clear that, for u £ Ut, 

u & Ut if and only if u takes finitely many values. (3-6) 
We have the following simple lemma whose proof is provided in Appendix for completeness. 



Lemma 3.2 (i) Uq is closed under pasting. That is, for u G Uq, t G [0, T], u % G Ut, 
« = !,••• , n, and disjoint {Ei,i = !,••• , n} C J~t, the following u is also in Uq: 



n 

u:= til[ 0) t) + \^u\u t )l Ei +ul n n =iE c 



l[t,T]- 



i=l 



(ii) Under Assumption \3. 11 it holds Ut x Vt C 



Proof. In light of (13.6|) . (i) is obvious. To see (ii), we notice that any pair of constant 
processes (u,v) is obviously in H f . Then (ii) follows from repeated use of Lemma [231 ■ 
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3.2 The Backward SDEs 

Let /(£, uj,y,z,u,v) : A x R x R rf x U x V — >• R be an F-progressively measurable nonlinear 
generator. Throughout the paper, we shall assume 

Assumption 3.3 (i) f (t,u, 0,0, u,v) is bounded by a constant Cq, and uniformly contin- 
uous in (t,U)) with a modulus of continuity function p$. 

(ii) f is uniformly Lipschitz in (y,z) with a Lipschitz constant Lq. 

Now for any (t,u) £ A, (u,v) £ lit x Vt, t £ T 1 , and J-^-measurable terminal condition 
7], recall the notation (|3.1|) and consider the following BSDE on [t, r]: 

f'T f'T 

y s = r]+ fvfaB^y^Zr^vJdr- Z r dB l r , P^-a.s. (3.7) 

J s J s 

We have the following simple lemma whose proof is presented in Appendix for completeness. 
Lemma 3.4 Let Assumptions \3. 1\ and \3.3\ (ii) hold, and 

L 2 {t,uo,u,v) :=E pt ^[|7 ? | 2 + ^' |/^(s,5',0,0,u s ,?; s )| 2 a!s] < oo. 

Then BSDE §31$) has a unique solution, denoted as {y t ' U) ' u ' v {r,rf\,Z t ' w ' u ' v [r,ri\) , and there 
exists a constant C , depending only on Cq, Lq, T , and the dimension d, such that 



sup \y^[r,r))\ 2 + [ T \Zl^ v [T,r))\ 2 ds\ < CL 2 (t,u;,u,v). (3. 

<S<T Jt J 



t<S<T Jt 

Moreover, if r <t + 5, then 



m>t,u,v 



sup l^'^Mll < c(M^ v [\r,\ 2 ]Y 2 +CSh (t,cj,u,v). (3.9) 

t<S<T ' V ' 



Throughout the paper, we shall use the generic constant C which depends only on Cq, Lq, 
T, and the dimension d, and may vary from line to line. 

3.3 The value processes 

We now fix an J-^-measurable terminal condition £ and assume throughout the paper: 

Assumption 3.5 £ is bounded by a constant Cq, and is uniformly continuous in ui with a 
modulus of continuity function pq . 

We now define the lower value and upper value of the game as follows: 

Y(t,u) := sup inf ^™[T,^]; Y(t,u) := inf sup ^™[T,^]. (3.10) 

ueu t v £Vt veVt u( zUt 
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As a direct consequence of Lemma 13.44 we have 

-C < Y < Y < C. (3.11) 
When there is no confusion, we will simplify the notations: 

Our goal of this paper is to show, under certain additional assumptions, that Y_ = Y and it 
is the unique viscosity solution of certain PPDE. See Theorem 15.11 below. 

Remark 3.6 (i) In this paper we restrict our controls to lit x Vt C 5$. We note that in 
general lit x Vt is not in H*. We may study the following problem though: 

Y.'(t,w) '■= sup inf yt> 0J > u ' v ; F(i,u;) := inf sup y^'"'^ 

where 

Vt(u) := |f G Vt : («,«) G 5 t |, W t (u) := |u G W t : («,«) G S t |, 

and we take the convention that, for the empty set <f>, sup^[-] = oo and inf^[-] = — oo. 
However, we will be able to prove only partial Dynamic Programming Principle in this 
formulation. 

(ii) Another important constraint we impose is that a and b are independent of to. When 
a and b are random, given (t, to) G A, the solution of SDE (J3T3]) and its distribution 
f>t,aj,u,v w -jj d e p enc l on w as well. This has some subtle consequences, e.g. in Lemma 14.11 
concerning the regularity of the value processes. The main difficulty is that we do not have 
a good stability result for feedback type of SDEs (|3.3p . We hope to address this issue in 
future research. 

(iii) Note that we may get rid of the drift b by using Girsanov transformation, so all our 
results hold true when b is random, given that a is independent of to. However, to simplify 
the presentation we assume b is independent of to as well. ■ 



Remark 3.7 For each (u,v) G Uq x Vo, denote ut := u t (X u ' v ) and vt := vt(X u > v ). Then 
(u,v) G W x V and F u ' v = P s >^ := pS,»(<M0,&(fi.S) . Thus we have y°'°> u ' v = y^'^ , where, 



a(s,u s ,v s ) dB s + b(s,u s ,v s )ds 



y 



S.u.v 



a:v ! '- r ) + f T f(s,x^,y^,z^,u s ,v s )ds 



^o-a.s. 
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However, we shall emphasize that the mapping from (u, v) to (u, v) is in pairs, and it does 
not induce a mapping from u to u (or from v to v). Consequently the game values defined 
below in strong formulation are different from the Y_ an d Yq m f)3. lQj) : 

Y_q : = sup ml y Q ' ' , Y Q := ml sup y ' ' . 

ueu 5eV o veVo ueu 

Indeed, in strong formulation the above game with control against control may not have the 
game value, namely < Yq, even if Isaacs condition and comparison principle for the vis- 
cosity solutions of the corresponding Bellman-Isaacs equation hold. See the counterexample 
Example 18.11 below . ■ 

Remark 3.8 (i) In standard literature, see e.g. [19] and [5], one transforms the problem 
into a game with strategy type of controls. That is, let a : Vt — > lit and (3 : lit — > Vt be 
appropriate strategies. One considers: 

y"(t,w) := supinf y^ a ^\ Y(t,u) : = inf sup , 



a 



v 



This type of control problem is in fact a principal-agent problem, see e.g. Cvitanic and 
Zhang |llj . In Markovian framework and under appropriate conditions, one can show 
that Y_ = Y and is the unique solution of the corresponding Bellman-Isaacs equation. 
However, in this formulation the two players have nonsymmetric informations, and the 
lower and upper values are defined using different information settings. In particular, it is 
less convenient to define saddle point in this formulation. 

(ii) Our weak formulation actually has the feature of strategy type of controls. Indeed, 
consider the (u, v) in Remark 13.71 again. Roughly speaking, given u, then u is uniquely 
determined by v, which is in turn uniquely determined by v. Thus u can be viewed as 
a strategy a which maps v (and B) to u. Similarly v can be viewed as a strategy (5 
which maps u (and B) to v. Compared to the strategy against control, the advantage of 
weak formulation is that it is control against control and the two players have symmetric 
information. ■ 

Remark 3.9 When there is only drift control, namely a is independent of (u,v), our for- 
mulation reduces to the work Hamadene and Lepeltier [21J. Under Isaacs condition, by 
using Girsanov transformation and comparison for BSDEs, they proved Y_ = Y and the 
existence of saddle point. We allow for both diffusion control and drift control, and we shall 
prove Y_ = Y . However, when there is diffusion control, the comparison used in [21J fails. 
Consequently, we are not able to follow the arguments in [21J to establish the existence of 
saddle point. Indeed, with the presence of diffusion control, even for stochastic optimization 
problem the optimal control does not seem to exist in general. We shall instead obtain some 
approximate saddle point in Section [7] below. ■ 
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4 Dynamic Programming Principle 

We start with the regularity of Y_ and Y in oj. This property is straightforward in strong 
formulation. Our proof here relies heavily on our assumption that a and b are independent 
of oj. As pointed out in Remark 13,61 (ii), the problem is very subtle in general case and we 
hope to address it in some future research. 

Lemma 4.1 Let Assumptions \3.1\ HO} and \3.5\ hold. ThenY_ andY are uniformly contin- 
uous in oj with modulus of continuity function Cpo for some constant C > 0. Consequently, 
Y_ and Y are ¥ -progressively measurable. 

Proof Let t G [0,T],w,a/ G SI. For any (u,v) G U t x V t , denote := ;y*> w w - 
-yty,« )U)Ai2: . = z t,u,u,v _ z t,u',u,v_ Then, P*' u ' u -a.s. 

A3> s = -^'{B 1 ) - f AZ r dB r + I \a r Ay r + AZ r a(r,u r ,v r )f3 r 

J s J s 

+[f' u (r, B\yl^ u > v ,Zl>"> u >\u r ,v r ) - /*' w '(r, 5*, ^*' w ' u,u , u r , v r )}] dr, 

where a and j3 are bounded. Apply f|3.8j) on the above BSDE, one obtains 

|3^' u ' u - ^''^1 < Cpodlw - o/|| t ). (4.1) 

Thus 

- < sup \y^ v - y^'^\ < c Po (\\u - 

(u,v)eu t xv t 

Similarly one can prove the estimate for Y. ■ 
The following Dynamical Programming Principle is important for us. 

Lemma 4.2 Let Assumptions 13.11 13.31 and 13.51 hold true. For any < s < t < T and 

oj G SI we have 

y» = sup inf y s s >"> u > v [t,Y_r}; Y s (oj) = inf sup y™* [t,Y s t '"] ■ 

To prove the lemma we need a technical lemma. Its proof is standard but lengthy, and 
is postponed to Appendix in order not to distract our main arguments. 

Lemma 4.3 For any e > and t G (0, T), there exist disjoint sets {Ei,i = 1, • • • , n} C Tt 
such that 

[|oj - oj'\\ t < e for all uj,uj' G E^i = 1, • • • ,n, and sup E p0 '"'" ( n™ =1 Ef) < e. 

(u,v)eUoxVo 
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Proof of Lemma \-j.S\ We shall prove only the Dynamic Programming Principle for Y_. 
The proof for Y is similar. Without loss of generality, we assume s = 0. That is, we shall 
prove: 



Y = sup inf y° '°' u > v [t,Y t ). 



(4.2) 



Step 1. We first prove ">". Fix arbitrary e > and u G IAq. Let {E{,i = 1, ■ ■ ■ ,n} C J~t 

be given by Lemma 14.31 an d fix an u l G for each i. For any co € Ei, By Lemma 14. II and 
(|4.ip we have 

|Y t H - < Cpo(e) and sup \y^' v > v - y^'^\ < C p (s). (4.3) 

(u,v)eU t xV t 

Let it* G lit be an e-optimizer of Y_ t (uj l ), that is, 

> + £ > Y t {J). (4.4) 



inf X 



Denote E n := nf =1 (£i) c . By Lemma (i) we define u e G U by: 

n 

«<H :=w,(£«;)l[o )t )(s)+ [^V s (o/)l^(u;) + l[t, T ]0) 



(4.5) 



i=l 



Now for any u G Vq, we have 



n 

~n0,0,u s ,v -> ,0,0,u e ,v I , ,0,0,u s ,v\ -,0,0,u e ,v f, -.jOjOjii'Sv., . -,,0,0,u e ,u-. 



i=l 



Since solutions of BSDEs can be constructed via Picard iteration, one can easily check that, 
for any (u, v) G Uq x Vq, 



veVt 



> inf yl' 

veVt 



3> t (w) = y t 

Then it follows from (jO|) and Lemma E2] that, for P^'^-a.e. uj £ Ei 

y t., 

J -^ v -Cp {s)>Y ± (u, i )-s-C Po (e) 
> Y t (u)-e-C Po (e). 

Therefore, by comparison principle of BSDEs and (|3.1ip we have 

n 

3V > 3V [*,2^ZflBi - (e + Cpo(e)) +y t " lfr 

i=i 

> 3# <"^ [t, Y, - ( E + Cp (e)) - ci in 
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Recall that sup (MeWoxVo P Q >"" v (£ n ) < e. Applying fl£2) we get 

y° '°' uS ' V > y°o'°' uS ' V [t,Y t ] -C( £ + Po ( £ ))§ = y° '°' u ' v [t,Y t ] - C(e + p (e))h 
Since v is arbitrary, this implies that 

inf y° °> uE ' v > inf y° Q ^ [t,Y t ] - C(e + Po (e))l 

Then 

Y > mfy° > ^[t,Y t ]-C(e + po(e))l 

vGVo 

Sending e — > and by the arbitrariness of u G Uq, we obtain 

y > snp inf y° '°' u > v [t,Y t ]. 
ueU v ^ v o 



Step 2. We now prove "<". Fix m € Wo in the form of (|3.5p . with Uij being replaced by 
Hij. It suffices to prove that 

inf y^ v < inf y%>°' %v [t, Y t ]. 

Without loss of generality, assume t = t io for some zq. Notice that Y_ t = £, then it suffices 
to prove 

inf y° '° M ' v [U +1 ,Y u+i ] < inf y '°> %v [ ti ,Y ti ], for all i. (4.6) 

We now fix i and recall that ut = 'YTj=\^ b ii^-E % f° r * e [*»>*i+l)- For any e > 0, let 
{Ef~, k = 1, • ■ , i^} C J-f. be given by Lemma 14.31 Denote E l - k := E l - n -E^ and fix an 

m,K 



^i* g £^ f or eac h (j ; /j). F or an y v g y 0) as i n Stepl we have 

rii,K 

y°o' m *[ti,Y ti ] = yr^E^E^+Y,^ 

j,k=i 

ni,K 

j,k=i 

By Step 1, we see that 



Y t \^ k )> sup inf yf k ' u > v [t i¥ i,Y*g h ] > inf y^ ^ \t l+1 ^>f] 



Here the constant denotes the constant process. Then there exists G such that 

^ k )>y^ k ^ v3k \t l+1 ^f]-e. 
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Now define 



rii,K 



w : = vl [0,ti) + 



[ E 



j,k=l 



By Lemma 13.21 we have v G Vo- Then, noting that u t I,w = Uij for a; G and t G [ti, 



i,fc=i 

j,k=i 



j,k=i 



rii,K 



= y° >°' u > e [t i+l , E - c(po( e ) + <o* 

> % '°^^ + i,^ !+1 l-C(po(e)+e)^ 



> mf % 

vev u 



C(po(e) + e 



Send e — >■ 0, by the arbitrariness of w G Vo we prove (|4.6p . ■ 

Remark 4.4 If we use strong formulation with control against control, as in Remark 13. 7| 
we can only prove the following partial Dynamic Programming Principle: 



yf (w) < sup inf y 3 '" 



■pS,S,U,V r g 



[Zf]; y>)> inf su P r A 



which does not lead to the desired viscosity property. That is why we use weak formulation 
instead of strong formulation. ■ 

We now turn to the regularity of Y_ and Y in t, which is required for studying their 
viscosity property. 

Lemma 4.5 Let Assumptions \3. I\ \3.3l and \3.5\ hold. Then, for any < t\ < t<i < T and 

uj G Q, 



\Y tl (u)-Y t2 (u)\ + \Y tl (u;)-Y t2 (u;)\ < Cp 1 [d 00 ((t 1 ,u J ),(t 2 ,u J ))j, (4.7) 
where pi is a modulus of continuity function defined by 

Pl {5) := p (5 + + 5 + 5 l * . (4.8) 
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Proof. We shall only prove the regularity of 7 in i. The estimate for Y can be proved 
similarly. Denote 5 := doo((ti,uj), (t2,Lu)). 
By Theorem 14,61 and Lemma 14.11 we have 



snp inf ytr' u ' v [t 2 ^]-Y t2 (u) 
ueu tl V&V H 



< sup 1 3^, 

ueUt 1 ,v£Vt 1 



[t2,Y 



h J 



(4.9) 



Denote 

y t : = 3^ w [i 2 , Yg'"] - Y t2 (u), Z t := Z*™ v [t 2 ,Y 
Then, P^'^-a.s. 



tl,W] 
*2 J 



Yll'" -Y t2 (u) + I f^(s,B t \y s + Y t2 (cj),Z s ,u s ,v s )ds 



t-2 



eti,u! 



t-2 



ZsdBl 1 . 



Recall from (13.11j) that Y is bounded. Apply (|3.9h and Lemma l4~T| we get 

1^1 < C(E^- [\Y! t ^-Y t2 (^]f+C5 

< c(E ptl ' u "[pg( ( i oo (( t2 , w ),(t 2 , Ll ;^ i ^i)))]) l + C7 ( 5. 

Note that 

< pl{5 + 6*) + Cf tl,U)V [\\B^ \\ t2 > tfl] < ^(<5 + 5 J) + C ' < r*E ptl ' tt '" [US* 1 ||f 2 ] 

< pl(5 + 5^ + 05^. 

Then 



< C 



p {5 + 5±) + 5^ +5 =Cp 1 (5). 



Plug this into (14. 9j) we complete the proof. ■ 
Combining Lemmas 14.21 and 14.51 it follows from standard arguments that 

Theorem 4.6 Let Assumptions \3. 1\ \3.3\ and \3.5\ hold true. For any (t,io) £ A and r £ T*, 
we /icwe 

ZtM = sup inf ^'«'«[r,y^]; F t (w) = inf sup ^ w [r, ] . 



17 



5 Viscosity solution properties 



Define 



■1 



G(t, 00, y, z, 7) := sup inf -o~ 2 (t, u, v) 17 + ba(t, u, v)z + f(t, ui, y, za(t, u, v),u, v) 
ue u^ev L2 

G(t, 00, y, z, 7) := inf sup -<r 2 (t, u,v) 17 + ba(t, u, v)z + f(t, ui, y, za(t, u, v),u, v) 

and consider the following path dependent PDEs: 

- 8 t Y t - G(t, uj, Y t , duYt, dl„Y t ) = 0; 
-d t Y t - G(t, u, Y t , 8„Y t , 3l w Y t ) = 0. 



(5.1) 



(5.2) 
(5.3) 



Theorem 5.1 Let Assumptions [3~H\ \3.3l and \3.5\ hold. Then Y_ (resp. Y) is a viscosity 
solution of PPDE (JO]) (resp. Q ). 



Proof. We shall only prove that Y_ is a viscosity solution of the PPDE (|5.2p . The other 
statement can be proved similarly. 

Step 1. We first prove the viscosity supersolution property. Assume by contradiction 
that there exists (t,oj) and tp € A L Y_(t,oj) such that 

c := d t <p(t, 0) +supinf {\cr 2 {t, u, v) : 8 2 w ip(t, 0) + ba(t,u, v)8 u ip(t,0) 

+f(t,oj,Y t (oj),d UJ (p{t,0)a{t,u,v),u,v)} > 0. 

By Remark (|2.5|) . we can assume L is large enough as we will see later. Then there exists 
u € U such that, for all v G V 

1 



dt<p(t, 0) + ^a 2 {t, u, v) : dl u op{t, 0) + ba(t, u, v)d^(t, 0) 
+f(t,oj,Y t (oj),d UJ (p(t,0)a(t,u,v),u,v) > - 
Let H £ be the hitting time corresponding to cp in (|3.2p . For any e > 0, set 



(5.4) 



inf {s > t : s - t + = e). 



By choosing e > small enough, we have H e < H. Since p G C 1 ' 2 (A t ), there exist some 
constant > Cq and modulus of continuity function p v > pi, which may depend on p, 
such that 

WfaB^lKCy, |^( S) B*)-V(i,0)| <p<p(e), fort<s<H £ , = <p, 8^,8^,8^. (5.5) 

Now set u := u 6 U t be a constant process and let u E Vt be arbitrary. Fix 5 > and 
denote := H e A {t + S), 

y ■— y L H £5 ^ H 5j) '■— L M e ' — h| J ' 

AY S := p(s, B l ) - y s , AZ S := d u <p(a, 5*) - Z s . 
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Then, applying the functional Ito's formula we obtain: 



dAY q 



dt<P + \tiL<P ■■ ° 2 ( s > u *' v s) + y s , Z„ Us, v s )] (s, B^ds + AZ s dB\ 
dt<P + \tiL<P ■■ ° 2 ( s > u s^s) + f> u (;y s ,Z s ,u s ,v s )\ (s, B l )ds + AZ s dB\ 
d t (f + -d^ip : a 2 (s,u s ,v s ) + f' w (-,Y t ((j),d u ip(-)a(s,u s ,v s ),u s ,v s ) (s,-B*)ds 



+ 



a s (y s -Y t (u)) + AZ s p s 



ds + AZ s dB l s , 



where \a\, \(3\ < Lq. By (|5.4p and (|5.5p we have 



- - C v p v [e) - C\y s - Y t (oj)\ + AZ s p s 



dAY s > 

Recall ((33D and define d¥ := M ii sdF t ' u ' v , where 



ds + AZsdBl, 



t<s<n £ . 



1 



2 



M s := exp^y [6(r,u r ,'u r .) + /3 r ]dW,** ur 
Then AZ s dB\ + AZ s f3 s ds is a P-martingale, and thus 



|6(r, u r ,v r ) + f3 r \ 2 dr 



AY t < E 



AY H , 



L2 



C^( £ )-C|X-y t (o;)| 



ri.s 



By choosing L large enough, we see that P € Then it follows from the definition of 
A L Y(t, u) that 

E F [AY H? ] = E F L(nf , B*) - Y$] < <p(t, 0) - Y t (oj). 

fc L s . 

Therefore, since b and f3 are bounded, 



Y t (uj) -y t <w} 



Jt 



^ + C^{e) + C\y s -Y t 



ds 



< [-5 + C^(e)}5 + C v 5P(h e <t + S) + C5E P \\y. - Y t (u)\\ H s 



< \~\ + C v p( £ )]5 + C^Mfe <t + S)y+ C8(E^- V [\\y - YtMWli ) a (5.6) 



Note that, for S < §, 



T>t,U,V 



6 + \\B%+s > e 



Dt,U,V I II Tjt 



lt+5 



> 



< 



c 



E f 



15 



* 1 1 2 



< 



C<5 



Moreover, denote y := y — Y t (uj). Then 



(5.7) 



= r£ - Y t {uj) + I f>»(r, B r ,y r + Y t (oo), Z r ,u r ,v r )dr 
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Z r dB\. 



By (|3.9p and applying Lemma 14.51 we obtain 



E 



\\y--Y t (u)\\is 



< cw 



+ C5 



< C5 + CE ff 



< C5 + CW 



p?(d 00 ((t,o;),(t + ( 5,L l ;)) + || J B t || m ))j < Cp 2 (<5), 



where 



p 2 (S) := 8+ sup E ¥t ' u ' v pj(d 00 {(t,uj),{t + 8,Lj)) + \\B t \\ t+ s)) 
(u,v)eU t xV t L 



(5.8) 



(5.9) 



Plug (j5T7|) and (j5T8j) into (|5Jl, we have 

It is clear that lim^o P2{8) = 0. Then by first choosing e small and then choosing 5 small 
enough, we have 

y t ( w )-^ w [ H f,z^] < -f* 

Since t> is arbitrary, we get 

inf ^ w [nf,y^] < 

ueVt 4 

which implies further that 



y t M - sup inf yl m [4,Y!£] < -t s < o. 

This contradicts with the dynamic programming principle Theorem 14.61 Therefore, Y_ is a 
viscosity supersolution of PPDE (|5.2j) . 

S^ep We now prove the viscosity subsolution property. Assume by contradiction that, 
for some L large enough, there exists (t,u) and ip E A L Y_(t,uj) such that 

-c := d t <p{t,0) + sup inf {\a 2 (t,u,v) : d 2 u ip(t,0) + b(t,u,v)d LU (p(t,0)\ 
+f(t,oj,Y t (oj),d u <p(t,0),u,v)} <0. 
Then there exists a mapping (no measurability is involved!) ip : U — > V such that, for any 

ueV, 

dt<p(t, 0) + ~<7 2 (i, u, if>(u)) : dl w tp(t, 0) + b(t, u, if,(u))d u (p(t, 0) 



+f(t,u,Y t (u),d u ( P (t i 0),u,if>(u)) < --. 



(5.10) 
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For any u E U t , by the structure (|3.5p one can easily see that v := ij){u) E Vt- Introduce 
the same notations as in Step 1, and follow almost the same arguments, we obtain 

Y t (u)-y t > 8[^-C vPv (e)-^-C5p\{5) . 

Again, by first choosing e small and then choosing 5 small enough, we have 

c 
I' 



This implies 



Y»- inf ^™K,Z^] > -A 

v£Vt e 4 



Since u is arbitrary, then 



rtM-sup inf X to [Hf,y^] > jS>0. 
u&At v€Vt e 4 

This contradicts with the dynamic programming principle Theorem 14.61 Therefore, Y_ is a 

viscosity subsolution of PPDE (15 - 2j) . ■ 

We now assume the Isaacs condition: 

G(t,uj,y,z,j) = G(t,u,y,z,j) =: G{t,u,y, z,j), (5.11) 
and consider the following path dependent Isaacs equation: 

- 8 t Y t - G(t, oj, Y t ,d u Y t , ahM) = 0. (5.12) 
Our main result of the paper is: 

Theorem 5.2 Let Assumptions [WH\ \3.3l and \3.5\ hold. Assume further that the Isaacs 
condition \5.11\) and the uniqueness for viscosity solutions of the PPDE (|5.12p hold. Then 
Y_ = Y =:Y and is the unique viscosity solution of PPDE (|5. 12|) . 

Proof. Applying Theorem 15.11 and by the uniqueness of viscosity solutions, we see imme- 
diately that Y_ = Y and it is the unique viscosity solution of PPDE (|5,12p . ■ 

Remark 5.3 (i) For the comparison principle of viscosity solutions of PPDE (I5.12p . we refer 
to Ekren, Touzi and Zhang |15| . We shall also provide a sufficient condition in Subsection 
[6] below. 

(ii) In Markovian framework, the PPDE (|5.12p becomes a standard PDE. Note that a 
viscosity solution (resp. supersolution, subsolution) in the sense of Definition 12. 41 is a viscos- 
ity solution (resp. supersolution, subsolution) in the standard literature. Then, assuming 
the comparison principle for standard viscosity solution of PDEs holds true, Y := Y_ = Y 
and is the unique viscosity solution of the Bellman-Isaacs PDE with terminal condition 
Y(T,x)=£(x) U 
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6 Comparison principle for viscosity solutions of PPDEs 



In this section we study the comparison principle of PPDE (|5.12p , which clearly implies the 
uniqueness required in Theorem 15.11 

We first cite a general result from [17J concerning wellposedness of PPDEs, adapting to 
our setting. For any (t, oo) G A, denote the following deterministic function with parameter 
(t,w): 

^(s,2/,z, 7 ) := G{sAT,u. At ,y, Zn ). (6.1) 

For any e > and n > 0, we denote T v := (1 + r])T, and 

O e := {x G R d : \x\ < e}, O e := {x G R d : \x\ < e}, dO £ := {x G R d : \x\ = e}; 

_ _ (6-2) 

Ot" := [t,T v ) x O e , := [t,T v ] x O e ), dO £ /> := ([t,T v ] x dO £ ) U ({T„} x £ ), 

Consider the following localized and path-frozen PDE defined for every (t, u) G A: 

( E )^ jt*»th ■- -Q t o - g t ^(s,9,D9,D 2 6) = on O e t ' v . (6.3) 

Here dt,D,D 2 are standard differential operators. 

Assumption 6.1 For any e > 0, rj > 0, (t,uj) G A, and any h G C®{dOl )TI ), we have 9 = 6_, 
where 

9(s,x) := inf < w(s,x) : w classical supersolution of (E)*'^ and w > h on dO\ ,r] >, 

r ' « i (6 ' 4) 

0(s, x) := sup < w(s, x) : w classical subsolution of (E) £ '^ and w < h on dOf ,v >. 
By |17j Theorem 3.4, we have 

Theorem 6.2 Let Assumptions \3. 1\ \3.3l [3751 and the Isaacs condition h5.11\) hold. Then, 
under the additional Assumption \6.1[ the PPDE (|5.12p has a unique viscosity solution and 
the comparison principle of viscosity solutions holds. 

We remark that Assumption 16. II is in the spirit of Perron's approach. However, in stan- 
dard literature the w in (|6.4|) is required only to be viscosity supersolution or subsolution, 
while we require it to be a classical one. To check that, we present a result concerning 
classical solutions of parabolic PDEs. 

We first simplify the notations. Let O C R d be open, connected, bounded, and with 
smooth boundary. Set 

O:=[0,T)xO, O:=[0,T]xO, dO := ([0, T] x dO) U ({T} x O) . 
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Consider the following (standard) PDE in O with boundary condition h: 

-d t 9-g(t,x,9,D9,D 2 9) = in O and 6 = hondO. (6.5) 

Then we have the following result, whose argument is standard in the literature and is 
communicated to us by Lihe Wang. We present its proof in Appendix for completeness. 

Lemma 6.3 Assume 

(i) h G C l > 2 (0) andg(;y,z, 7 ) G C l > 2 {p) for any (^,7); 

(ii) g is continuously differentiable in (y,z, 7) with bounded derivatives; 
(Hi) d^g > CQld for some cq > 0, and d < 2. 

T/ien the PDE (|6.5p /ias a classical solution 9 G C 1,2 (0). 

We now have 

Proposition 6.4 Let Assumptions \3.1\ EOI I3.51 and £/ie Isaacs condition 15.11]) hold. As- 
sume further that 

°~ > cold f or some cq > and i/ie dimension d < 2. (6-6) 

T/ien Assumption \ 6.1\ holds true. Consequently Y_ = Y =: Y and is the unique viscosity 
solution of PPDE (I5TT2I) . 

Proof. We use the notations in Assumption 16. 11 By [16J Proposition 3.14, we may assume 
without loss of generality that 

G(-,yx,-) -G(-,y 2 ,-) <V2-yi for any y 1 > y 2 (6.7) 

First, one can easily extend h to a uniformly continuous function on [i, 00) x W 1 , still 
denoted as h. For any 5 > 0, let Or'" and /t<5 be smooth mollifiers of g t,ul and /i such that 
Wg^ — 5II00 < ^ — ^||oo < ^- By our assumptions, it is clear that oqI^, < d^g 1 ^ < LqI^. 
Apply Lemma l6.3[ the following PDE has a classical solution 9 5 G C 1 ' 2 (0(' T '): 

-d t 9 s -g t 5 ' UJ ( S ,9 s ,D9 s ,D 2 9 s ) = 0, in 0^, 5 = fcj on dO s t «. 

Denote 

^ : = 6» 5 + 5 and £5 := 9 S - 6. 

Then clearly 9 S G C 1 ' 2 ^'"), 6 S > h on dO £ t ' v . Moreover, by (jHTFj) 

L 4 '% = -d t 9s-g t > UJ (s,9s + 5,D9 s ,D 2 9 s ) 
> -d t 9s-g t > UJ (s,9s,D9 s ,D 2 9s) + 5 
= gf{a, 9 S , D9 5 , D 2 9 5 ) - g^is, 9 8 , D9 5 , D 2 6 s ) + 5 > 0. 
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Then 9$ is a classical supersolution of (E)*'^, and thus 9 < 9$. Similarly, 9< 9$. Then 

< 9 - 9 < 9 5 - 9 S = 25. 
Since S > is arbitrary, we conclude that 9 = 9_. ■ 

7 Approximate saddle point 

In this section we discuss briefly saddle points of the game, assuming the game value exists. 
In our setting, it is natural to define 

Definition 7.1 We call (u*,v*) £ Uq x Vo a saddle point of the game if 

3V < 3V < 3V for all ueU ,veVo- 

We remark that, if a saddle point (u*, v*) exists, then it is straightforward to check that the 
game has a value Yq := 3^o'°' U • However, even in stochastic optimization problem with 
diffusion control, in general the optimal control may not exist. We thus study approximate 
saddle points only. 

Definition 7.2 For any e > 0, we call (u £ ,v £ ) £ Uq x Vo an e-saddle point of the game if 

y0 M _ £ < ■yO.O.u',*' < yV,0,u*,v + £ ^ u £ Uq, V G V . 

We have the following simple observation: 

Proposition 7.3 Assume the game has a value, then it has an e-saddle point (u £ ,v £ ) for 
any e > 0. 

Proof. Let Y_ = Yq = Yq be the game value. Then for any e > 0, there exist u £ G Uo,v £ G 
Vo such that 

Y - e < mf 3^ ' < y < sup % < *o + £• 

In particular, this implies that 

Y -e< inf ;y < o > u ^ < yPW.* < sup ■ y 1 o ) « 1 «« < y + £ . 

That is, (n £ ,vj e ) is an e-saddle point. Moreover, we observe that I^q' '" ~~ ^o| < £• ■ 



24 



8 Appendix 



8.1 Proof of Lemma 1X21 

We prove the case A S only. The case A W can be proved similarly. Let X be the unique 
strong solution to SDE (|2.7p with coefficients (<r, b) , and X % be the unique strong solution 
to SDE (J22JI on with coefficients (a*,^). 
First, denote 



*»l[o,t)(«) + 



Xt + ^E^XKB' 



l [t,T]( 



< s < T. 



i=i 



One can check straightforwardly that X is a strong solution to SDE (|2,7p with coefficients 
(<t, 5). On the other hand, let X be an arbitrary strong solution to SDE (|2.7p with coefficients 
(a, b). Then both X and X satisfy SDE ([2"77|) on [0,t] with coefficients (a, b). By the 
uniqueness assumption of (a,b), we see that X = X on [0,t], Po-a.s. In particular, this 
implies 1^(X) = lg.(.X'). Then for Po-a.e. w £ ^, there exists unique i such that 1^(X) = 
1 E .(X) = 1. Thus both and X*-" satisfy SDE fl277|) on [t,T] with coefficients (a 1 ,^)- 
By the uniqueness assumption of (cr*, 6*), we see that X t,u = X t,UJ , P -a.s. This implies that 
X = X, Po-a.s. and therefore, (a, b) £ A . 

Finally, since X = X on [0,t], we have P°~ b = P CT ' 6 on F t . Moreover, since ^(B 1 ) = 
X t (uj) + X^B 1 ) whenever Ie^X) = 1, by the definition of r.c.p.d. we see that (P^) 4 -" = 
F t,a\v for p<r,&_ a-e . u e Ei. U 



8.2 Proof of Lemma [3.41 

Recall the P^'^-Brownian motion W t,u,v defined in (|3.4p . One may rewrite BSDE (|3.7p as 

f t,lJ (r, -B*, y r , Z r , u r , v r ) + Z r b(r, u r ,v r ) 



y s = r] + 



dr 



Z r dW r 



t.u.v iuit,u,v 



a.s. 



Then (|3.8p follows from standard BSDE arguments. Moreover, note that 



y s = V + 



/*' w (r, B\ 0, 0, u r , v r ) + a r y r + Z r (3 r 



dr 



Z r dW r 



t,u,v mt,u,v 



a.s. 



where a, [3 are bounded. Denote 
r r := 

Then 

pr 

pt,u) 



exp ( jf p s dW!' u ' v + f\a r - \\P r \ 2 ]dr) . 



y t = T rV + TrfffaB^O^UrtvJdr- [■■■]dW r t ' u ' v , P^-a.s. 
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Thus 



13* 



E 



T t t]+ / r r /^(r.B.*, 0,0, u r ,v r )dr 

J s 

+<E pt ^[||r||^])"(E p ^[ J \f>»(r,B!,0,0,u r ,v r )fdr 
It is clear that E^'"'" [||r[|£] < C. Then fl3ji follows immediately. 



8.3 Proof of Lemma 14.31 

We introduce the following capacity C: 



C(A) := sup F°' U > V {A), for all A G J^- 

(m,-u)gWoxVo 



(8.1) 



In this proof we abuse a notation a little bit by denoting B^ := B r — B s for < s < r < t. 
Step 1. We first show that, for any c, 5 > 0, and i? > 0, 



C(||B|| t > fl) < — and C( sup ||B s ||( s+<5 ) At > c) < — . 



■2) 



Indeed, for any (ii,i>) 6 Z^o x Vo and any < t\ < t2, since a and 6 are bounded, then by 
(|3.4p and applying the Burkholder-Davis-Gundy Inequality we get 





jl^lli 




sup 


/ 






-<l<s<t 2 





a(r, u r , v r )b(r, u r , v r )dr + / <r(r, ii r , u r )<iVF"' 1 ') 



ti 



< CE r ' 



|cr(r, u r , v r )b(r, u r , v r )\dr I + 



*2 x 2 

|<r(r, u r , v r )\ 2 d, 



i.3) 



Then 



1511* > 5] < -^E 



151 



< 



1*" 



By the definiton of C, this implies the first estimate in (|8.2p . 

Next, let = t\ < ■ ■ ■ < t m = t such that 5 < At{ < 25 for all i. Then 



SUp \\B S \\r s+S } At 
0<s<t 



max sup sup \B r — B s \ 

0<i<m-l u < s <t i+1 s <r<(s+S)At 



< max sup sup 

0<i<m-l t .< s < 4 . +1 S < r <( s+< 5) A ( 

< 2 max \\B U 



\B r — B t . I + \B S — B± 



0<i<m-l 
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Then, noting that m < j, by (|8.3p we have 



dO,u,v 



0<s<t 



SWp \\B S \\( S+5 ) M > c) < — il, sup n ±J \\(s+5)At 



V"'" [ 

c 4 L 



sup \\B 

0<s<t 



si|4 



I R*'l 4 
1-° It* +35 



„ m-1 
< 5_J- E P — 

C i=0 

By the definition of C we obtain the second estimate in (|8.2p . 
S^ep We now fix e > 0. For the constant C in (|8.2p . set 

-5 



< -mi 2 < 



,1 ' 



4 

e . ere 

c := -, J := — A t = 

3' 2C 162C 



At, R:=( — )4. 



Let = to < • • • < t m = t such that 5 < At, < 28, i = 1, • • • , m. Clearly there exists a 
partition {Ej, 1 < j < n} C T% such that 

U^-iEj = { max |_B+.| < R + cl and max \ujt- — uj' t I < — for all w,u/ G E~. 

J J l0<i<m J 0<i<m * ' 3 

Now set 

Ej := ^ n A, where 4 := { sup \\B a \\, s+s)M < c) € J" t . 

L 0<s<t J 

Then for any uj,uj' E Ej, 



\u-uj \\ t 



max sup \u) s — u) s \ 
0<i<m-l ti <s<u +1 



< max sup 

0<i<m-l t z <s<t i+1 

< max sup 

0<i<m-l ti <s<t i+1 



\u a -u ti \ + Ws-u'u 



K - (Jul 



e e e 
3 + 3 + 3 



e. 



On the other hand, 



U?_! ) U A c = { max LB t . I > i? + c\ U A c 
J V Lo<i<m J 

C (( max |B t . I > i? + cl n A] UA C . 
For each w G | maxo<i< m |-Bt 4 | > R + c j n A, we have 



||a;||t = max sup |w s | > max sup 

0<i<m-l tt <s<t i+1 0<i<m-l t i < s <t i+1 

That is, 



\lv u \ - \lv s - u u \ >(R + c)-c = R. 



{ max \B t . I > i? + c) C\A C (||SL>i?l, 

1 0<t<m J I J 

and therefore, 

n^ =1 ^c{||B|| t >i2}uA c . 

Now it follows from ||j£2J that C(n™ =1 £|) < e. 
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8.4 Proof of Lemma 16.31 



As standard in PDE literature, it suffices to provide a priori estimates. That is, we assume 
9 G C 1,2 (0) satisfies PDE (|6.5p . and we shall provide estimates which depends only on the 
parameters in our assumptions. 

(i) We first establish the estimates in the case g = 5(7). We proceed in several steps. 

Step 1. We first cite a result from Ladyzenskaya et al [25]. Assume 9 satisfying the 
following linear PDE: 

-8 t 9-^A(t,x) :D 2 9 = 0, 

where A = [aj,-li<j j<d is required only to be measurable and < cqI^ < A < Cold . Then 
9 G Cj£ c , where a depends only on Co and Cq. 

Step 2. We next cite a result by Caffarelli [SJ. 

The elliptic PDE g(D 2 9) = f(x) with / G C a has C 2 ' a -solution 
if the simplified PDE g(D 2 9) = constant has C 2,Q -solution for some a > a. 

Step 3. We also need the DeGiorgi-Nash estimate: If j=i Ae, {o-ijD Xj 9) = 0, then 
9 G C a . See, e.g., Gilbarg and Trudinger [20] Theorem 8.22. 

Step 4- We now come back to the PDE ()6.5[) with g = 5(7). First, set 9 := dtO. 
Differentiate both sides of (|6.5|) with respect to t we obtain: 

d t 9 + [d^g(D 2 9)} : D 2 9 = 0. 

By Step 1, we have d t 9 = 9 G Cf < a . Now fix t. Then flCTI]) becomes 

g(D 2 9) = -d t 9 G C a . 

By Step 2, it suffices to show that 

g(D 2 9) = constant has C 2,a '-solution for some a' > a (8-4) 

For this, we can only prove in the cases d = 1 or d = 2. 

In the case d = 1, notice that g is strictly increasing, then D 2 9 = constant and thus 9 
is a parabola. 

In the case d = 2, fix k = 1, 2 and denote 9 k := D Xk 9. Differentiate both sides of (|8.4p 
with respect to Xk- 

A : D 2 9 k = 0, where A := [a i j] 1 < id < 2 := d l9 {D 2 9) 
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Note that an > c > 0. Then 

Dl lXl e k + a ^Dl iX2 e* + a ^Dl 2X2 e k = o. 

an a n 

For I = 1,2, differentiate both sides of the above PDE with respect to xi and denote 
k > 1 ■= D Xl 9 k = Dl kX fi: 

Dl lxl e^ + D Xl (^Dl 1X2 9 k ) + D XI (^Dl 2X2 k ) = 0. 

In the case 1 = 2, this is: 

d x1 (D xi e k i) + d X2 ( a -^D xl e k A + d X2 ( a -^D X2 e k A = 0. 

Van ' Van ' 

By Step 3, k < 2 G C Q . Similarly, G C a . That is, for any t, 0(t, •) G C 2+a . Moreover, it 
follows from PDE (|6,5|) that 9 is differentiable in t and thus 9 G C 1 ' 2 . 

(ii). We now consider the general case where g = g(t, x,y, z, 7). We define a map 
J : C^ 2 (0) -> C l ' 2 (<5) by J6» := 9, where, thanks to (i), 9 is the classical solution of the 
following PDE: 

-d t 9 - g(t, x, 6, D6, D 2 6) = in O and 9 = 9ondO. 

Now, following the arguments in [26j Theorem 8.2, one can show that the mapping J is a 
contraction mapping if T is small enough. Moreover, the fixed point 9 of the mapping J is 
also in C 1,2 (0). Therefore, we can conclude the so called small time existence: the PDE 
(|6.5p has a classical solution when T is small enough. 

Next, |26j Theorem 14.4 gives an a priori uniform estimate for the H61der-(l + 5) norm of 
the classical solution to (I6.5p . for some 5 G (0, 1), where the definition of the Holder- (1 + 5) 
norm is given in |26| Chapter IV, Section 1. Using this a priori estimate and following 
the arguments in [26] Theorem 8.3, we can infer the existence of the classical solution over 
arbitrary time duration [0,T] from the small time existence, and thus complete the proof. 
■ 

8.5 Buckdahn's counterexample 

As pointed out in Remark 13.7] a game with control against control in strong formulation 
may not have the game value, even if the Isaacs condition and the comparison principle for 
the associate Bellman-Isaacs equation hold. The following counterexample is communicated 
to us by Rainer Buckdahn. 

Example 8.1 Let d = 2, U := {x G R : \x\ < 1}, V := {x G R : \x\ < 2}, and U (resp. 
V) be the set of ¥ -progressively measurable U -valued (resp. V -valued) processes. Write 



29 



B = (£?, 5 2 ). Given (u,v) G U x V, the controlled state process X u ' v = (X 1 ' U ,X 2 ' V ) is 
determined by: 



X l t ' u := aB\ + I u s ds, X^ v := aB 2 t + f 
Jo Jo 



Veds 



where a > is a constant. Define, for some a£l, 



J(u,v) :=E P ° 



| a ~\- Xr^ Xrjl | 



Y_ : = sup inf J(u,v), Y : = inf sup J(u, v). 



Then, for < a < y ^ and \a\ < T, we have Y_ < Yq. 
Proof. For any u G W, set v% := Ut + Then u G V and, 



a + A j? — A T = a 



+ aB?+ utdt-aBr- [u t + —}dt = a[B^ - B\\. 
Jo Jo T 



Thus 



J(u, v) = aE 1 



\Bj> — Bji\ 



aV2T 



This implies that inf„ e y J(u,v) < ay2T. Since u is arbitrary, we get 

Y < aV2T. 



(8.5) 



On the other hand, for any v G V, set 



a-W[X z /} 



a _ E pu [X%°] I " {a ~ EP ° ^ X T V ^°} + 1 {«-E p0 [x% v ]=Q} ■ 



u t := u 

That is, u is a constant process. One can easily check that 

ueU, Kl = l, a-E p °[X^] =uo|a-E p °[X^]|. 

Then 



E 



Ob T" ^Yr^ v\rp 



a + u T - E r ° [xj"] = u T + \a - E r " [X% 



r2,Ul 



Thus, 



J(u,v) > 



E 



T + |a-E p °[X^] 



T + |a-E p °[X^]| > T. 



J.6) 



This implies sup MgW J(u, u) > T. Since t> is arbitrary, we have Yq > T. This, together with 



3J implies that Y_ < Yq when < a < 



2 ■ 
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Moreover, note that in this case the system is Markovian and d^Y = DY. The Hamil- 
tonians in fl5J]) become: for (t,x,y,z,j) £ [0, T] x R 2 x R x R 2 x S 2 , 

G(t, x,y,z,j) := sup inf -atr (7) + uz\ + v z 2 = ^atr (7) + z{ - 2z^; 
uev v ^ L 2 J 2 

G(t,x,y,z, 7) := inf sup -atr (7) + uzi + vz 2 = ^atr (7) + zf - 2z^ . 

Then the Isaacs condition holds, and the corresponding Bellman-Isaacs equation becomes: 
1 



dfY t - -a 



KxJt + Di 2X2 Y t - [D Xl Y t } + + 2[D X2 Y t }- = 0. 



It is clear that the comparison principle for the viscosity solutions of above PDE holds. 



Remark 8.2 (i) The above counterexample stays valid when a = 0, and thus the game 
is deterministic. We note that, even in deterministic case, our weak formulation is dif- 
ferent from strong formulation. Indeed, the corresponding state process X w,u,v in weak 
formulation is: 



X 



W,l,u,v 
t 



f u{s,X w ^\X w > 2 > u > v )ds, X^' 2 ' u ' v = f 
Jo Jo 



v{ Sl X w ^\X w ^ v )ds. 



In particular, X w,2,u,v depends on u as well. Consequently, given v, one cannot define u 
through (|8.6p . 

(ii) In this paper the drift coefficient is ba, see (|3.3p . so the above deterministic example 
is not covered in our current framework. However, this assumption is mainly to ensure the 
wellposedness of the BSDE (|3.7|) . When / = 0, one may define the value processes via 
conditional expectations, instead of y. Then we may consider X in the form of (jl.2p and 
all our results, after appropriate modifications, will still hold true. In particular, the above 
deterministic game in weak formulation has a value. ■ 
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